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(57) ABSTRACT 

Image data combined of a first piece of and a second piece 
of image data and selection data to selectively designate one 
of the first piece or the second piece of image data is input 
to an input portion 1. Those data are expanded by an 
expanding portion 4. A first image-structure recognizing 
portion 2 (second image-structure recognizing portion 3) 
recognizes the image structure of the first (second) piece of 
image data. A first image-structure converting portion 5 
(second image-structure converting portion 6) converts the 
recognized image structure of the first (second) piece of 
image data to the image structure of an output device 9. 
Those image data and the selection data are expanded. A 
combining portion 7 combines the first piece and the second 
piece of image data having the same image structure as of 
the output device while successively selecting the first piece 
or the second piece of image data on a basis of the selection 
data, and outputs the combined image data to the output 
device 9. The output image data has the same image 
structure as of the output device 9. An image or picture 
reproduced by the output device 9 is high in quality. 

12 Claims, 13 Drawing Sheets 
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IMAGE PROCESSING APPARATUS AND 
IMAGE PROCESSING METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates to an image processing 
apparatus which receives input image data in the form of 
separated data, combines those data, and outputs the com- 
bined one. Further, the present invention also relates to an 
image processing method. Besidfi &.ahfi ^reseDt invention 
may..%c-ztso--appUedto color facsimile machines^^^orjd; 
transmission 

The facsimile communication through pubUc lines and the 
image or visual communication through the networks of 
public lines and LANs are widely used at present. Various 



example, the resolution of the input device in the sender side 
is sometimes different from that of the output device in the 
receiver side. Other factors defining the image structure, 
-such as the color„space,.the number^of gradation levels, and 
; the screen structure, are also different between the sender 
side and the receiver side frequently. To transmit the image 
data whose image structure is different from that m the 
receiver side, the image structure of the image data in the 
sender side must be conformed to that of the output device. 

° SUMMARY OF THE INVENTION 

Accordingly, an object of the present invention is to 
provide an image processing apparatus which provides a 
high speed transmission of image data, exactly reproduces 



public lines and LANs are widely used at present. Various original image of high quality, and outputs the image data 

types of machines for transmitting and receivmg image data ^^^^ ^ structure is conformed to the image structure 



are presented, for example, facsimile machines, personal 
computers, multi-function digital copying machines, and 
network printers. The market and technical progress have 
rapidly replaced those old machines handling only mono- 
chromatic or black/white images with the machines capable 
of handling color images. In particular color facsimile 
machines and color printers takes a major market share. The 
network system may interconnect different types of 
machines of different resolutions or different color spaces, 
e.g., color copying machines and monochrome copying 
machines. 

In the image data communication between the machines 
of different image structures, an original image input to the 
machine is usually handled as one plane image. The sender 30 
side judges the type of original document, selects the process 
most appropriate to the judged original, applies the appro- 
priate process to the plane image over its entire image, and 
sends the processed image data to the receiver sjde. If an 
original image, i.e., an image on an original "document, is 35 
represented by image data of one attribute, viz., it consists 
of only characters or photograph, no problem arises in 
handling the original image as a single plane image. 
However, problem arises if the original image has two or 
larger number of attributes, for example, the original image 40 
contains characters and photograph. To compress the image 
data containing character or textual data and pictorial data, 
the same data compression method is applied to both the 
textual and pictorial image data. In this case, in some type 
of data compression method, a data compression ratio of the 45 
textual image data is different from that of the pictorial 
image data, and this results in deterioration of the image 
quality of the textual or pictorial image data. 

ITie resol ution^ the color space, and the nnmhp.r yra- 
,i.TfrTrr-h»r;;:Trnf the ima ^e data, whu -h tlefine the image sn 
iOmemreTTrar image data, are sometimes converted before . 
Ilielransm ission ot the image daULin ^^^^^ ^" ^^^^^^ ^he 
ammint nl data to be transmitted. Also in this case, the image 
Hata is entirely processed by the sameimage^stm 
conversion pib'cS'ss. WheT-e~it is^eguedlEn^^ 
image da ta'istransmitted-in-high'imagequality, it is neces- 
sary to transmit the whole image-data-in-higii-image quality. 
This results in increase of the amount of /the image data 
transmitted. Where it is required that the' image data is 
transmitted in a real time fashion or at.high speed, the image 60 
data must be transmitted at low resolution. In this case, the 
image quaUty is inevitably deteriorated. 

A target image"stmci05eitO::whi^jt^^ structureo.f 



the input image data is converted is determinedin4h^^ 
sidertiTttifTietwoTfcrimtige-c^^ the target image 65 

structure determined in the sender, side is not always coin- 
cident with the image structure in the receiver side. For 



whose image structure is conformed to the image structure 
of the output device. 

Another object of the present invention is to provide an 
image-structure converting method which allows the image 
processing apparatus having the above useful functions to 
operate. 

In the present invention, input image data is received in 
the form of at least three separated data, a first piece of 
image data, a second piece of image data, and selection data 
to selectively specify the first piece or the second piece of 
image data, and the first piece and the second piece of image 
data are combined and then output. The first piece and the 
second piece of image data, and the selection data are 
subjected to the image-structure conversion process, e.g., 
resolution conversion process -"^^ ^^^'"-^Pflt^r ^Tpnversinn^ 
process^ jnd the coni2 resfiinn pmcc&S, whirh Rre self^^tfid^e- 
,jgg;ij^rjti ar ^^'^^ tte k ^ta characteristics -and the b egtiof 
tKoSrieparated data^For the data not requiring high 
Y eiiOlutiuu, its icso imion is converted into a low resolution. 
For the data requiring high resolution, the data is processed 
while at high resolution. Thus, the separated 'data having 
different image structures are received, and an original 
image may be reconstructed with the separated image data 
received, whereby the reduction of data amount and repro- 
duction of the original image of high quality are reaUzed. 
Further, use of the separated image data provides a high 
speed image data transmission. 

The image stmctures of the first piece and the second 
piece of image data and the selection data are determined 
when the image data is generated. The characteristics of 
those data and the resolution of the input device also 
determine the image structures. This necessitates correct 
combining of the separated image data irrespective of their 
image structures. The same thing is true also for a case 
where the image data, while being separated, are stored m 
the image data base, for example, and the image data is 
referred to. The fact that a quaHty output image or picture 
cannot be secured unless the image structures of the input 
image data are conformed to .the image structure of the 
output device, is also true. 

The present invention handles the first piece and the 
second piece of image data and the selection data to selec- 
tively specify the first piece or the second piece of image 
data, which rnake up input image data, in the following 
manner: those separated data are received; the image struc- 
tures of the separated data are conformed into the image 
structure of an output device; then those image data are 
combined; and the combined image data is output. 

Thus, the invention reproduces an original image or 
picture of high quaUty irrespective of the image structures of 
the input image data since the separated image data are 
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combined after the image structures of the separated data are an original image, specified by the ftindamental attributes of 

conformed to the that of the output device. the original image, such* as resolution, color space and 

gradation level. 

BRIEF DESCRIPTION OF THE DRAWINGS The input portion 1 receives image data from an external 

ni^ 1 ■ Li 1 1- L • . 5 device. The input image da ta is obtained thro nrh n mmmii 

MG. 1 is a block diagram showing an image processing . . — r ^ — c — : — H j 

uu- r* ui* .r.u *- Hication caDie ot a net work or a facsimil e machmc or read 

apparatus which is a first embodiment of the present inven- , ■ . . « vl - • — , • / — 

^.^^ out ot an extcrflal s torage device. The input imagrtata, as 

will be described later, is separatodiaioa first piece of image 

no. 2 is a specific example of image data input to the j^ta, a second piece of image dataT^JJa^s^tecttes-dala.^ 

image processing apparatus of the first embodiment. selectively specify the first piece or the second piece of 

RGS. 3A to 3C are explanatory diagram showing some image data, and the image slrufctures of those separated data 

image data formats. are converted into the image structure adapted for those data. 

FIG. 4 is a block diagram showing a specific configuration The first image-structure recognizing portion 2 recognizes 

of each of the first and the second image-structure recog- the image structure of the first piece of image data. The 

nizing portions used in the image processing apparatus 15 second image-structure recognizing portion 3 recognizes the 

which is the first embodiment of the invention. image structure of the second image data. The expanding 

no, 5 is a block diagram showing a specific configuration P^'^^^io" expands the input image data, if it is compressed, 

of the first and the second image-structure converting por- ^"^o original image data. The first image-structure convert- 

tions in the image processing apparatus of the first embodi- Portion 5 converts the image structure of the first piece 

^gp^ 20 of image data into the image structure of the output device 

/- a L . L • r.u • 9. The second image-structurc convcrting porfion 6 convcrts 

FIG. 6 is a flow chart showing an operation of the image . , , C-u j- • ■ 

f.u c r u\i- . the image structure of the second image data into the unage 

processing apparatus of the first embodiment. , *, r.u n rj^^ ,.. « 

^ & structure of the output device 9. The combining portion 7 

HG. 7 is a block diagram showing an image processing combines the first piece and the second piece of image data 

apparatus which is a second embodiment of the present ^5 having the same image structure on a basis of the selection 

invention. j^^^ y^e output-device image-structure storing portion 8 

FIG. 8 is a flow chart showing an operation of the image stores the image structure of the output device 9. 

processing apparatus of the second embodiment. The output device 9 outputs of the combined image data. 

FIG. 9 is a block diagram showing an image processing The output device 9 may be a printer or a display. The 

apparatus which is a third embodiment of the present 30 combined image data may be stored into a storage device, 

invention. e.g., a disc, or sent to another device via a network or a 

FIG. 10 is a flow chart showing an operation of the image communication cable, 

processing apparatus of the third embodiment. ^ specific example of image data -input to the image 

T-T/- 11 ■ ui I J- u • • processing apparatus under discussion is illustrated in FIG. 

FIG. 11 IS a block diagram showing an image processing i, * • V /ax er^ir^ cuxT^r^T^r^» 

u- u • r -*u u J • * r *u ^ 35 2. An unage shown in (A) of FIG. 2 consists of "ABCDE 

apparatus which is a fourth embodiment of the present . • . i W • . • 

. and a picture enclosed by a square. The image data is 

separated into character data "ABCDE" ((C) of FIG. 2) and 

HG. 12 is a flow chart showing an operation of the image pictorial data of the picture ((D) of FIG. 2). The selection 

processing apparatus of the fourth embodunent. j^^a indicates which of the character data or the pictorial 

FIG. 13 is a block diagram showing a network system 40 data is to be selected for combination of those image data, 

including the image processing apparatus constructed In this instance, the selection data selects the character data 

according to the present invention. on only the character portion, particularly only the black 

FIG. 14 is a block diagram showing an image communi- painted portion fefrming the fine segments of characters. In 

cation apparatus. another case, it sclectsr the pictorial data. For ease of 

FIG. 15 is a block diagram showing a specific example of illustration, the character data is illustrated in the form of 

an image data separator. ^^^^^ painted pixels. 

In the instance of FIG. 2, the selection data of (A) of FIG. 

DETAILED DESCRIPTION OF THE 2 and the character data of (B) of FIG. 2 look to be the same, 

PREFERRED EMBODIMENTS Actually, the selection data of (A) of FIG. 2 needs only to be 

<First Embodiment> 50 information to discriminate between the character data and 

FIG. 1 is a block diagram showing an image processing the pictorial data for its selection, and in this instance it is 

apparatus which is a first embodiment of the present inven- constructed with binary data to discriminate between the 

tion. In the figure, reference numeral 1 is an input portion; character data and the pictorial data. The character data of 

2 is a first image-structure recognizing portion; 3 is a second (C) of FIG. 2 further contains color information if the 

image -structure recognizing portion; 4 is an expanding 55 characters are colored, 

portion; 5 is a first image-structure converting portion; 6 is In the separated character data, the pixels corresponding 

a second image -structure converting portion; 7 is a combin- to the pictorial data, for example, an image region corre- 

ing portion; 8 is an output-device image-structure storing sponding to the pictorial data in the character data of (C) of 

portion; and 9 is an output device. The image processing FIG. 2, may be expressed in white data, for example, 

apparatus of the first embodiment receives a first piece and 60 Similarly, in the separated image data, the pixels corre- 

a second piece of image data; converts the image structures sponding to the character data, for example, an image region 

of those input image data into the image structure of the of "ABCDE" of the pictorial data of (D) of FIG. 2 may be 

output device;/ combines those image data by use of a expressed in white data, for example, 

selection signal, which is received together with the input The separation of the image data into the character data 

image data; and outputs combination signal from the output 65 and the pictorial data produces the following advantages. It 

device. In the description to be given hereunder, the term is possible to apply to the character data an image structure 

"image structure" indicates a data structure representation of conversion process, e.g., resolution conversion and color 
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conversion, suitable for the character image, and apply to the and the second piece of image data are converted to the 
pictorial data another image structure conversion process image structure of the output device, 
suitable for the pictorial image, e.g., photograph image. This To convert the image structures of the first piece and the 
fact implies that the amouni of data handled is reduced, a second piece of image data, it is necessary to recognize the 
data compression ratio is increased, and further the image 5 image structures of those image data. As already referred to, 
data is transferred or stored with little degradation of image [^^^ i™ag^ ^^^^ i°P"^ the input portion 1 is such that the 
quality image structures of the character data, pictorial data and 
In the above instance, the image data is separated into two selection data are converted into the image structures suit- 
types of image data, character data and pictorial data. If ^^^^ ^^ose data, and are arranged into a predetermmed 
required, the pictorial data may be separated into a further lo ^^f header storing mformation on the miage 
number of data types, for example, photograph data and CG "'"^^^^^ 

/ L • \ J . T .u- fu * J . • tormat. The first and the second image -structure recogmzing 

(computer graphic) data. In this case, the un age data is -^^^ ^ 3 .^^^^ ^^^^^^^^^ 

separated into four different types of image data, character -^^ j^e second piece of image data by referring to the 

data, photograph data, CG data, and selection data. The header 

image data may be separated into three different types of 15 piGS. 3A to 3C are explanatory diagram showing some 

data; character data, character color data and pictorial data. i^age data formats. As shown in FIG. 3A, the header is 

In this case, the selection data contains edge information, followed by the three compressed data of the selection data, 

and hence it is treated as character data. In a case where the the first piece of image data and the second piece of image 

character is colored in one specific color, e.g., black, the data. The image structure information of the respective data 

character data may be simplified by use of given data. Thus, 20 are placed in the header. 

it should be understood that in the present invention, there In an image data format shown in FIG. 3B, a general 

is no limit in the number of separated data and the data header is followed by a combination of a header for selection 

construction. data and the compressed selection data (located in this 

In this instance, for the selection data, it is desirable that order), a combination of a header for first piece of image 

the resolution is as high as possible in order to secure clear 25 data and the compressed first piece of image data, and a 

contours of characters and line drawings. In a case where the combination of a header for second image data and the 

selection data is used only for discriminating between an compressed second image data. The image structure infor- 

image region containing characters and line drawings and mation of those data are placed in the headers associated 

another image region containing the picture, the selection with those data, respectively. 

data may be provided for each image region containing 30 In an image data format shown in FIG. 3C, headers are 

several pixels or a given image region, attached to the compressed data, respectively. Also in this 

The image data input to the input portion 1 is such that the format, the image structure information of those data are 

image structures of the character data, pictorial data and placed in the headers associated those data, respectively, 

selection data as shown in FIGS. 2(B) to 2(D) are converted The image data arranged in any of the image data formats 

into the image structures suitable for those data, and are 35 shown in FIGS. 3Ato 3C is input to the input portion 1, and 

arranged into a predetermined image format. In this the first and the second image-structure recognizing portions 

embodiment, the first piece of image data and the second 2 and 3 refer to the header or headers attached to the first 

piece of image data may correspond to the character data or piece and the second piece of image data, and recognize the 

the pictorial data as desired. image structures of those image data. 

^ There is the possibility that the image data input to the 40 FIG. 4 is a block diagram showing a specific configuration 

/ input portion 1 have been converted in their image structure of each of the first and the second image-structure recog- 

/ to reduce the amount of data as described above. In a case nizing portions 2 and 3 used in the image processing 

' where image communication devices of different image apparatus which is the first embodiment of the invention. In 

structure specified by resolution, color space, the numbeFof the figure, reference numeral 21 is a header-information 

gradation levels, and'Qt|i^&-.are interconnected, t he image 45 extracting portion; 22 is a color-space recognizing portion; 

stnirnirgs nf the Hal^-tfThp TgrT^ffS 



"ifn itt nr lTn r rl rt rrm in ed in the and 23 is a gradation-level recognizing portion. Here, the 

transmission s ide, and _a re different fnn^^ jr^ngp H^tij ^nH color space and the number of gradation levels are used for 

each data, and also with the performances' (e.g., resolution, the factors of the image structure. 

the number of gradation levels, and color space of the input The header-information extracting portion 21 separates 
device). The reception side needs to be capable of normally 50 input image data into header information and the first piece 
combining and reconstructing the received image data irre- or the second piece of image data, and sends the header 
^spective of the image structures of the image data. The same information to the color-space recognizing portion 22 and 
thing is tme not only for the case of the communication of the gradation-level recognizing portion 23. The same sends 
the image data but also for the case where the image data is the first piece or the .second piece of image data to the 
retrieved from a data base and is reproduced. 55 expanding portion 4. The color-space recognizing portion 22 
In a case where the image structures of the separated data, processes the header information to recognize color space 
in particular of the first piece and the second piece of image information. The gradation-level recognizing portion 23 
data, arc different from each other, the combining portion 7 processes the header information to recognize gradation 
cannot correctly combine those separated data through its information. The results of the recognition by the color- 
simple combining. To cope with this, the first embodiment 60 space recognizing portion 22 and the gradation-level recog- 
processes the first piece and the second piece of image data nizing portion 23 in the first image -structure recognizing 
for their image structure conversion before their combining portion 2 are sent to the first image-stmcture converting 
process. To merely secure a normal combining process, it is portion 5. The resuhs of the recognition by the color-space 
only needed to coincide the image structure of the first piece recognizing portion 22 and the gradation-level recognizing 
of image data with that of the second image data. In this 65 portion 23 in the second image -structure recognizing portion 
embodiment, those data are finally output lo the output 3 are sent to the second image-structure converting portion 
device. Because of this, the image structures of the first piece 6. 
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FIG. 5 is a block diagram showing a specific configuratioo 
of the first and the second image-structure converting por- 
tions 5 and 6 in the image processing apparatus under 
discussion. Id the figure, reference numeral 31 is a color- 
space converting portion and 32 is a gradation-level con- 5 
verting portion. As shown in FIG. 4, the recognition results 
of color space information and gradation information are 
output from the first and the second image-structure recog- 
nizing portions 2 and 3. The first and the second image- 
structure converting portions 5 land 6 convert the image iO 
structures of the first piece and the second piece of image 
data on the basis of the recognition results. 

The color-space converting portion 31 receives the color 
space information from the gradation-level recognizing por- 
tion 23 and the color space information of the output device 15 
from the output-devioe~'iinage-structmi~st^^ 
and converts the color space of the image data expanded by 
the expanding portion 4 into the color space of the output 
device. The gradation- level converting portion 32 receives 
the gradation information from the gradation-level recog- 20 
nizing portion 23 and the gradation information of the output 
device from the output-device image-structure storing por- 
tion 8, and converts the number of gradation levels of the 
color-space converted image data to the number of gradation 
levels of the output device. 25 

While the gradation-level converting portion 32 follows 
the color-space converting portion 31 in the illustrated 
instance, the color-space converting portion 31_may follow 
the gradation-level converting portion 32. The conversion 
processes of the color-space converting portion 31 and the 30 
gradation-level converting portion 32 in the first image- 
structure converting portion 5 may be different from those in 
the second image-structure converting portion 6, respec- 
tively. The target image structure of the image structure 
conversion processes may be different from the present one, 35 
i.e., the image structure of the output device. The processes, 
e.g., a screen process, which are essential to the output 
device, may be carried out for each data. 

FIG. 6 is a flow chart showing an operation of the image 
processing apparatus thus constructed. In a step vSlOl, a first 40 
piece and a second piece of image data and selection data are 
input to the input portion 1. In a step S102, the first 
image -structure recognizing portion 2 recognizes the image 
structure, e.g., color space and the number of gradation 
levels, of the first piece of image data received. And the 45 
second image -structure recognizing portion 3 recognizes the 
image structure of the second image data. In recognizing the 
image structure of the image data, each image-structure 
recognizing portion refers to the header and extracts the 
image -structure information of the received image data in a 50 
case where the image data has such a data structure with a 
header containing information about the image structure. If 
the information on the image structure is not present, the 
image -structure information may be extracted from the 
whole image data or preset values may be used for the 55 
image -structure information. Where the first and the second 
image -structure recognizing portions 2 and 3 are each 
arranged as shown in FIG. 4, the header-information extract- 
ing portion 21 extracts the header from the image data; the 
color-space recognizing portion 22 extracts a color space of 60 
the image data; and the gradation-level recognizing portion 
23 recognizes the number of gradation levels. 

Where the image data is compressed, the expanding 
portion 4 expands the first piece and the second piece of 
image data, and the selection data in a step S103. 65 

In a step S104, the first and the second image -structure 
converting portions 5 and 6 read each the image structure of 
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the output device 9 from the output-device image-structure 
storing portion 8. The information about the image structure 
may be set in advance by an operator. Alternatively, the 
image processing apparatus inquires of the output device its 
image structure, and stores the resultant image structure into 
the output-device image-structure storing portion 8. In 
another alternative, preset information may be stored in 
advance. 

In a step S105, the first image -structure converting por- 
tion 5 converts the image structure, e.g., color space and 
gradation level, of the first piece of image data, which was 
recognized by the first image -structure recognizing portion 
2 into the image structure of the output device 9 which was 
read out of the output-device image-structure storing portion 
8. Similarly, the second image -structure converting portion 
6 converts the image structure of the second image data into 
the image structure of the output device. Where the first and 
the second image-structure converting portions 5 and 6 are 
arranged as shown in FIG. 5, the color-space converting 
portion 31 converts the color space of each of the first piece 
and the second piece of image data into the color space of 
the output device 9, for example, an RGB color space for the 
CRT display (as output device), and a CMYK or CMY color 
space for the printer. A multi -dimensional lookup table may 
be used for the color space conversion. If the lookup tables 
are provided for all the input values, a number of the lookup 
tables need to be used. To avoid this, the input values are 
sampled at proper intervals and the lookup tables are formed 
for those samples input values. The input values stored in the 
tables are obtained in a proper interpolation manner. A cubic 
interpolation is preferable for the interpolation to find the 
input values not found in the tables. A matrix calculation or 
a one -dimensional lookup table may be used for the color- 
space converting method. Any other interpolation than the 
cubic interpolation may be used as a matter of course. For 
the conversion of the number of gradation levels, the 
gradation-level recognizing portion 23 operates to convert 
the number of gradation levels of each of the first piece and 
the second piece of images to the number of gradation levels 
of the output device 9. A one-dimensional lookup table may 
be used for this conversion. A bit-shift method or a 
multiplication/division method may be used in place of the 
one-dimensional lookup table. 

In a step S106, the combining portion 7 combines the first 
piece and the second piece of image data by use of the 
selection data. Specifically, the combining process is carried 
out pixel by pixel while selecting the pixel of the first piece 
or the second piece of image data that is specified by a value 
of the selection data. For example, when the value of the 
selection data is "0", the pixel of the first piece of image data 
is selected, and when it is "1", the pixel of the second image 
data is selected. Alternatively, the selection data consists of 
a plural number of bits, and a more complicated operation, 
e.g.. Boolean operation or arithmetic operation, is used. 

In a step S107, the image data combined by the combining 
portion 7 is sent to the output device 9 which in turn outputs 
an image in a visual manner. 

As described above, even if the image structure of the 
input image is different from that of the output device, the 
image processing apparatus of the first embodimenl converts 
the image structure of the input image data to that of the 
output device. Therefore, the output device produces an 
image of high quality. 
<Second Embodiment> 

FIG. 7 is a block diagram showing an image processing 
apparatus which is a second embodiment of the present 
invention. In the figure, like or equivalent portions are 



06/17/2004, EAST version: 1.4.1 



us 6,441,913 Bl 
9 10 

designated by like reference numeraU in FIG. 1 showing the converted to that of ^y2"\ndiZn i^^l '^nvertinl 
first embodiment, and reference numeral U is an image- converting method and the S"dat. on level ^^^^^^^^^^ 
structure recognizing portion, and 12 is an image-structure method, which were employed by and referred to in the first 

cS n?pTon. InL image p.^^^^ ^■"'"'T°!;"'"*''"'aS^^^^ 
second embodiment the first piece of image data has the 5 ratus under discussion. A step SU7 is finally executed, ibe 
ame tmagf^S; as of the second pie« of image data. image data with the converted image ^tructu^ ts outpu to 
ATirJiTglproSssingapparatuscombines the first piece and the output device 9, which in turn produces an miage 
the second niece of imaee data on a basis of the selection visually. . , ■ • *u • 

?ata anS converte thelmage structure of the combined As seen from the foregoing descnp ion. he image pra- 
Se data to Ih image structure of the output device. ^o cessing apparatus of the second embotoent cames out the 
Z imaee^tructure recognizing porUon 11 recognizes image-structure converting process of only the combined 
the i^asTiLcmrwh ri commonly used for thi first image data. Therefore, the storage devices and converUng 
£c3t"nk pieL of image data. To recognize the devices, which are required, are reduced m number and 
fl^ stmcturneimage-structuferecog^ hence the image processing apparatus . simphfied m its 

refers to the header attached to the image data. If the data 15 configuration, 
sinicture is not contained in the header, preset information <Thu^d Embodiment> 

ry"d forthe image structure, ihe image-stnicture FIG. 9 is a block diagram showing an >-age P-c-sing 
™izfa7portion 11 may be configured as shown in HG. apparatus which is a third embodiment of the present 
recognizing poruuii x± m y & invention. In the figure, like or equivalent portions are 

The image-structure converting portion 12 converts the 20 designated by like reference numerals in FIGS^l and 7 
image s^cmre^f the combined image data to the image showing the first and second embodiments. The miage 
^r^fmre^nhe output device 9, which is obtained from the processing apparatus of the present embodiment converts 
ouTpuTdev iS^^^^ *e image stmctures of the first piece and '^e second piece 

ofre rec^g^i ion result produced from the image-structure of image data to another image structure; combines he fi^t 
raSeSportion 11. lie image-structure converting por- 25 piece and the second piece of image data on a basis of he 
to ™yKnflgured as shown in FIG. 5. selection data; and converts the struc ure o the 

ma. »iL flow chart showing an operation of the image combined image data to the image structure of the output 

nrocessine aoparams thus constructed. A step Sill is first device. 

execufed a fii^t piece and a second piec« of image data and TTie first image-structure convertmg ^rtion 5 converts 
Son data are input to the input portion 1. A step S112 30 the image structure of the first piece o '"nage data to a 
LTxe^tcd- the image-strucmre recognizing portion 11 predetermined or second image structure. The second 
TecognSs a color spa« and the number of gradation levels image-structure converting portion 6 converts the m^age 
oTthe toput toage data, which specify the image structure. structure of the second unage data to the second un ge 
mere the header attached to the input image data contains structure. The first piece and the second piece of image data 
Tcolor space and gradation levels to specify the image 35 after underwent the image-structure process, have each the 
ti^cmre the linage structure is extracted from the header. second image structure. Tlie second image stmcture may be 
S ^ch nform tion is not contained in the header or the the image structure of the first piece or the Piece of 

headlr Ts not used, a preset value may be used for the image data, or another image smicmre construe ed on the 
r^Snit^on ofX mage structure. If the image -structure basisof the image stmctures of the first piece and the second 
Sniz^ng Sor ion 11 is configured as shown in FIG. 4, the 40 piece of image data, m first and image-stmcture convertmg 
hTader^for^ation extracting portion 21 extracts the header portions 5 and 6 may be configured as shown m FIG. 5. The 
Ero^th7~mage datafthe color-space recognizing first and the second image-structure recognimg portions 2 
portion 22 recognizes a color space of the input image data; and 3 may be configured as shown m JIG. 4. 
and the gradation-level recognizing portion 23 recognizes Tlie image-structure converting portion 12 <»nverts the 
he number of gradation levels. The results of the recogni- 45 second image strucmre of the combined miage data to the 
ion ar^ou put fo the image-stmcture converting portion 12. image structure of the output device 9, which is read out of 
Next a Step S113 is executed: if the input image data is the output-device image-structure stormg portion 8. Where 
comS^^rSe expanding portion 4 expands the first piece the second image structure of the image data resulting tarn 
and Uie^a>nd piece of image data and the selection data. A the combining process is determined on the miage structures 
tep smS^executed: the combining portion 7 combines the 50 of the first piece and the second piece of miage data m he 
fl^t p eci and the second piece of image data by use of the first and the second image-structure "-nverting portiot« 5 
s^TecUo^data. Specifically! the combining process is carried and 6, the second image structure is obtamed from the fi^t 
Tut n xel by pixel, and he value of the selection data or the second image-structure converting portion 5 or 6 and 
specifies' he'flL pi;ce or the second piece of image data to then is converted to the image structure of the output device 

^'':l:Sin?^'°^cZ^^^ --rting " FIG. 10 shows a flow chart of an operation of Jus 

nortion 12 reads out the image structure of the output device constructed image processmg apparatus of the third embodi- 
r^mtheout^uS^^^^ mcnt.Tostartwith,astepS121isexecuted:themputporUon 
a Z S116 I executed: th'e image-structure converting 1 receives the first piece and the second piece of image data 
port on 12 converts the color space and gradation level of the 60 and the selection data. Astep S122 is executed: the first and 
Se structure of the combined image data to those of the the second image-structure recognizmg portions 2 and 3 
taage s mcture of the output device 9. which are read out of recognize the image strtictures of the fi«' Pf the 
Te output-device image-structure storing portion 8. The second piece of image data received. Where the header 
color space of the combined image data is converted to the attached to the input image data contams a color space and 
RGB Slor space for the display device as the output device. 65 gradation levels to specify the image su-ucture. the miage 
and th^ CMYK or CMY ^lor space for the printer. The structure is extracted from the header. Where such infomia- 
num^r of gradation levels of the combined image data is tion is not contained in the header or the header ,s not used. 
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a preset value may be used for the recognition of the image 
structure. If the first and the second image -structure recog- 
nizing portions 2 and 3 are configured as shown in FIG. 4, 
the header-information extracting portion 21 extracts the 
header from the input image data; the color-space recogniz- 5 
ing portion 22 recognizes a color space of the input image 
data; and the gradation-level recognizing portion 23 recog- 
nizes the number of gradation levels. The results of the 
recognition output from the first image -structure recogniz- 
ing portion 2 are output to the first image-structure convert- lo 
ing portion 5, while the recognition results output from the 
second image -structure recognizing portion 3 are output to 
the second image-structure converting portion 6. 

A step S123 is executed: if the input image data is 
compressed, the expanding portion 4 expands the first piece is 
and the second piece of image data and the selection data. 

A step S124 is executed: the first and the second image- 
structure converting portions 5 and 6 converts the image 
structures of the first piece and the second piece of image 
data into a second image structure which is defined in 20 
advance. In an example of the second image structure, a 
color space is an L*a*b* space, and the number of gradation 
levels is 25 6; L* ranges 0 to 100, and a*, b* range each -128 
to 127. The second image structure may be the same as of 
the first piece of image data or the second piece of image 25 
data, or another image structure constructed on the basis of 
the image structures of the first piece and the second piece 
of image data. 

A step S125 is executed: the combining portion 7 com- 
bines the first piece and the second piece of image data by 30 
use of the selection data. Specifically, the combining process 
is carried out pixel by pixel while selecting the pixels of the 
first piece or the second piece of image data that are 
specified by the values of the selection data. 

A step S126 is executed: the image-structure converting 35 
portion 12 reads out the image structure of the output device 
9 from the output-device image-structure storing portion 8. 
A step S127 is executed: the image-structure converting 
portion 12 converts the image structure of the combined 
image data to the image structure of the output device 9, 40 
which is read out of the output-device image -structure 
storing portion 8, The color space of the combined image 
data is converted to the RGB color space for the display 
device as the output device, and the CMYK or CMY color 
space for the printer. The number of gradation levels is 45 
converted to the number of gradation levels at which the 
output device 9 can produce the image data. Where the 
second image structure of the image data resulting from the 
combining process is determined on the image structures of 
the first piece and the second piece of image data in the first 50 
and the second image-structure converting portions 5 and 6, 
the second image structure is obtained from the first or the 
second image-structure converting portion 5 or 6 and then is 
converted to the image structure of the output device 9. A 
step S128 is finally executed: the image data with the S5 
converted image structure is output to the output device 9, 
which in turn produces an image visually. 

The color space converting method and the gradation 
level converting method, which were employed by and 
referred to in the first embodiment, may be used by the first 60 
and the second image-structure converting portions 5 and 6, 
and the image-stmcture converting portion 12 in the image 
processing apparatus of the third embodiment. 

In the image processing apparatus of the second 
embodiment, the image-structure conversion of the image 65 
data is carried out two times before and after the combining 
of the image data. Therefore, it is possible to select the image 
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Structure suitable for the image combining. Where a plural 
number of output devices 9 are used, the image-structure 
converting portion 12 need only to be increased in number 
correspondingly. In this respect, the versatility of the image 
processing apparatus is good. 
<Fourth Embodiment> 

FIG. U is a block diagram showing an image processing 
apparatus which is a fourth embodiment of the present 
invention. In the figure, like or equivalent portions are 
designated by like reference numerals in FIG, 1 showing the 
first embodiment. In the figure, reference numeral 41 is a 
select-data resolution recognizing portion; 42 is a first-image 
resolution recognizing portion; 43 is a second-image reso- 
lution recognizing portion; 44 is a select-data resolution 
converting portion; 45 is a first-image resolution converting 
portion; 46 is a second-image resolution converting portion; 
and 47 is an output-device resolution storing portion. The 
image processing apparatus of the fourth embodiment con- 
verts the resolution of each input image data, which is one 
of the factors defining an image structure of the image data, 
to the resolution of the output device; combines the input 
image data of the converted resolution on a basis of the 
selection data; and outputs the combined image data in a 
visual manner. The selection data selectively specifies one of 
the first piece and the second piece of image data, and is 
binary data. Therefore, the selection data is nonsense for the 
conversion of the color space and the number of gradation 
levels as other factors of the image structure. However, there 
is a case where the resolution of the selection data needs to 
be converted. In the fourth embodiment, the selection data is 
subjected to the image-structure conversion process. The 
illustrated configuration of the image processing apparatus is 
based on the configuration of the first embodiment, but the 
apparatus may be configured on the basis of the second or 
third embodiment apparatus. 

The select-data resolution recognizing portion 41 recog- 
nizes a resolution of the selection data. The first-image 
resolution recognizing portion 42 recognizes a resolution of 
the first piece of image data. The second-image resolution 
recognizing portion 43 recognizes a resolution of the second 
image data. 

The select -data resolution converting portion 44 converts 
the resolution of the selection data recognized by the select- 
data resolution recognizing portion 41 to a resolution of the 
output device 9, which is stored in the output-device reso- 
lution storing portion 47, The first-image resolution con- 
verting portion 45 converts the resolution of the first piece 
of image data to the resolution of the output device 9, which 
is stored in the output-device resolution storing portion 47. 
The second-image resolution converting portion 46 converts 
the resolution of the second image data to the resolution of 
the output device 9, which is stored in the output-device 
resolution storing portion 47. 

The resolution conversion methods used for the select 
data resolution converting portion 44 and the first- and 
second-image resolution converting portions 45 and 46 may 
properly selected from among known conversion methods in 
accordance with the data characteristics. Examples of the 
resolution conversion methods adaptable for high speed 
processing are a zero-order hold method and a nearest- 
neighbor method. FIG. 5 is a diagram for explaining the 
zero-order hold method. As shown, this method is an algo- 
rithm in which an output pixel P is replaced with an input 
pixel located preceding to the output pixel. When one of 
those methods is used for the resolution conversion, the 
resultant image is not satisfactory in image quality. A 4-point 
interpolation method, for example, is usually used as the 
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resolution conversion method providing satisfactory image 41 and the first- and the second-image resolution recogniz- 

quality and processing speed. A projection method, a ing portions 42 and 43, to the resolution of the output device 

16-point interpolation method, a logic operation method and 9, which is read out of the output-device resolution storing 

others take each a relatively long processing time but portion 47. 

provides a quality image. The logic conversion method may 5 ^ step S136 is executed: the combining portion 7 com- 
be enumerated for the resolution conversion method effec- ^^"^ ^^^t piece of image data whose resolution was 
tive for the conversion of a resolution of the line drawing converted by first-image resolution converting portion 45, 
taking the form of binary data. From those resolution and the second image data whose resolution was converted 
conversion methods, one may select proper resolution con- second-image resolution converting portion 46 by 
version methods for the select-data resolution converting lO use of the se ection data whose resolution was conN^ 

*u c . • 1 AS the select-data resolution convertmg portion 44, The com- 

portion 44, the first-image resolution c«nvertmg portion 45 ^^^^ ^^^^^^ P.^^, ^^^^^^.^^ 

and the second-image resolution convertmg portion 46 may ^^^.^^ ^ while selecting the pixel of the first 

be selectedfrom among those known resolution conversion ^-^^ j^e second piece of image data in accordance with 

methods. The same resolution conversion method may be t^e value of the selection data. A final step S137 is executed: 

used commonly for those resolution conversion methods, as is the combined image data is output to the output device 9, 

a matter of course. The resolution conversion methods for which in turn produces an image visually, 

those resolution converting portions may properly be As described above, even if the resolutions of the input 

selected from among those known resolution conversion image data and the selection data are different from the 

methods in accordance with the type of input image data and resolution of the output device 9, the image processing 

the characteristic of the output device. 20 apparatus of the fourth embodiment can produce the image 

If the resolution recognized by the select-data resolution data at the resolution of the output device 9. In the fourth 

recognizing portion 41 is substantially the same as the embodiment, only the resolution of the image structure is 

resolution of the output device 9, there is no need of the converted; however, other factors ofthe image structure may 

resolution conversion by the select-data resolution convert- also be converted in similar ways when the fourth embodi- 

ing portion 44. llie same thing is true for the combination of 25 ment is combined with the first to third embodiments, 

the first-image resolution recognizing portion 42 and the llie image processing apparatuses of the respective 

first-image resolution converting portion 45, and the com- embodiments of the invention are arranged so as to carry out 

bination of the second-image resolution recognizing portion the image-structure conversion process of the input image 

43 and the second-image resolution converting portion 46. data. If required, the image processing apparatus may be 

The output-device resolution storing portion 47 stores the 30 arranged so as to carry out various processes that are applied 

resolution of the output device 9. The resolution of the to the output device 9 depending on its type, e.g., digital 

output device may be set in advance, entered by the user at screen, analog screen, sharpness correction, and gamma 

the time of outputting the image data, or obtained by correction, in addition to the image-structure conversion 

inquiring it of the output device 9. process. Those processes may be applied to the selection 

FIG. 12 shows a flow chart of an operation of the thus 35 data and the first piece and the second piece of image data 

constructed image processing apparatus of the fourth at a proper location between the expansion stage of the input 

embodiment. To start with, a step S131 is executed: the input image and the combining stage or after the combining 

portion 1 receives the first piece and the second piece of process. 

image data and the selection data. A step S132 is executed: In the first, third and fourth embodiments, the first image- 

the select-data resolution recognizing portion 41 and the 40 structure recognizing portion 2, second image-structure rec- 

first- and the second -image resolution recognizing portions ognizing portion 3, select -data resolution recognizing por- 

42 and 43 recognize the resolutions ofthe first piece and the tion 41, and first- and second-image resolution recognizing 

second piece of image data and the selection data. Where the portions 42 and 43 are located between the input portion 1 

header attached to the input image data contains information and the expanding portion 4. If required, those recognizing 

to specify the resolution, the resolution is extracted firom the 45 portions may be arranged in parallel with the expanding 

header. Where such information is not contained in the portion 4 as in the second embodiment, 

header or the header is not used, a preset value may be used Some applications of the above-mentioned embodiments 

for the recognition of the resolution. The recognition result of the present invention will be described. An image data 

output from the select -data resolution recognizing portion 41 communication through a network will first be described, 

is sent to the select -data resolution converting portion 44; 50 FIG. 13 is a block diagram showing a network system 

the recognition results from the first-image resolution rec- including the image processing apparatus constructed 

ognizing portion 42, to the first-image resolution converting according to the present invention. FIG. 14 is a block 

portion 45; and the recognition result from the second-image diagram showing an image communication apparatus. In the 

resolution recognizing portion 43, to the second-image figures, reference numerals 51 to 53 are image communi- 

resolution converting portion 46. 55 cation apparatuses; 54 is a filer server; 55 is a personal 

A step S133 is executed: if the input image data is computer; 56 is a network; 61 is a scanner; 62 is a processor; 

compressed, the expanding portion 4 expands the first piece 63 is an image data separator; 64 is an image combining 

and the second piece of image data and the selection data. portion; 65 is a controller; 66 is a transmitter/receiver; 67 is 

A step S134 is executed: the select-data resolution con- a printer; 68 is an operating portion. In the network system 
verting portion 44, the first-image resolution converting 60 of FIG. 13, three image communication apparatuses 51 to 53 
portion 45 and the second- image resolution converting por- each having an image input device and an image output 
tion 46 read out the resolution of the output device 9 from device, the filer server 54 for storing a plural number of input 
the output-device resolution storing portion 47. A step S135 image data, and the personal computer (PC) 55 with a 
is executed: the select-data resolution converting portion 44, display device are interconnected through the network 56. 
and the first- and the second-image resolution converting 65 Various devices may additionally be connected to the net- 
portions 45 and 46 convert the resolutions, which are work 56. Further, the network 56 may be connected to other 
recognized by the select -data resolution recognizing portion devices and networks by way of a public line. 
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Each image communication apparatus reads out image to 53 is -para^^^^^^^^^^ P^-' n-J^J agTdatatZu 

ffaSrca^S^a^^^^^^^^^^ r;L^;nnSrrCthi,henetworl56,^ 

£LtslKTt;K3Ato3C.Theimagestruct^ structure of each data is determined m the traBsmtssjonsid^ 
taaTe data^ determined in the transmission side for its s for its reasons. The reception side needs to correct y com- 

™s The reception side receives the image data from the bine the received image data havmg the different mage 

transmission side- checks the image structures of three data stmctures and to output the resultant data. To this end, Ifte 

of the image data, which are described in the header attached j^jge processing apparatus of the present invention may be 

to the image data; converts the image structures of the used. Specifically, the reception side incorporating the image 

respective data so as to allow the combining process of those processing apparatus checks the image structures of the 

image data into an original image; combines the data mto the respective data while referring to the header, for example; 

original image; converts again the image structure of the ggtiverts the various factors defining the image structures, 

combination image data to the image structure of the pnnter; example, the resolutions of the data, the color spaces and 

and outputs the image data to the pnnter. number of gradation levels of the flist piece and the 

Tlie image communication apparatuses 51 to 53 are each ^^^^ ^^^^ .^^^^ ^^^^ image gtmcture which 

configured as shown in FIG. 14. As shown, the image ^^^^^ ^^^^^^ functional block in the reception side to 

processing apparatus includes the scanner P/"^^' f^' correctly combine the respective data, i.e., the first piece and 

transmitter/receiver 66, prmler 67 and the operating portion co y p ^^^.^^ ^^^^ ^^^^ 

68. TTie scanner 61 reads out image data f™'" an origmaL the^^eond piece g 

The processor 62 includes the ^^^^^1X^65'^. 20 Jeceptin side can correctly'combine the image data output 

image combinmg portion 64, and the controller o=- - J^.„„ ... imaee communication apparatuses 51 to 53. 

image data separator 63 separates the image data read out o ^^^i f^ ^'^em^n^de carries out an appropriate 

the original into three data, first piece and secotid piece of Tliereafter **J^«P/^"^ ^^^^ j^^^ge data 

image data and selection data, and compresses hese da a^ ^TcaTt^ handkd by h^^^^^^^ device, e.g., prinfer and 

transmitter/receiver 66 sends the mage data ^ ; ^^^^^ application of the invention is a commu- 

communicat^on apparatus or aPPa^^he flle^serv^^^ 54 communication is set up between 

reconstructed image data on a prmtingmedium^m oper- f g™^^^^^ ^j^h a disc device of large 

^—Hia^rE ^^^^^^^ 

fourth embodiments of the invention is incorporated mto the the disc device^ .^^ 

image combining portion 64 and the '^-'j^'^^^JS of ^ch of J ^g theTmage dau'm three data as shown in FIG. 

the image communication apparatuses 51 to 53 The image 40 "^P^^'^^"^ .^^ , block diagram showing a 

processing apparatus of the invention may be incorporated 2 will be descnbed. " ,„ ,he figure, 

fnto the pirsonal computer 55. In this case, it - mcorp°rated f^^^^^^^^f^^^^^f^^^ is an attribute 

into the functional portion where the received image data is '.^^^^^^^Zn 73 t a 2-layer separator; 74 is a first 

output to the display device. In this instance, the pnnter 67 i-^^^P^^^'^l^^^^^^^^.^^s is a 'second image- 

Trntlt^Tm' of HG U thrr^eitTofthe " ^ LTrvU poniol'76 is a select-.ata compr.^^^ 

In the networlc system oi riu. x^, „p«.nnat oortion- 77 is a first-image compressing portion; 78 is a 

different from the resolutions of the input and output '''^Ef'^ _^ 7^ ro^^ed for conv^^ 

devices, i.e., the scanner, the P^^f'^'^^'^l^'l^Tt^ '° spa^ oTITmlg dJa oufput froip the scanner The 
The RGB color space is used for *e «,lor spaces of the spa« m g j^^^ ^^^^^^^ 

scanner and the display device, and the YMC or JMCK ^ JeLAB color space as a common color space 

color space is used for the printer. Other factors of the image .^^/^'"P'^'f^f^^^^^ altribule>dging portion 72 

stnictures are sometimes different among those devic^.m f y '"^; ^^^te^^^^^^^^^^ for e ch pi^el or every 

image data is transmitted through the network 56. 55 J^Jf '^^^ 

efficient data t-s~ .^^^^^^^^^^^ rfn^^ ° Tprcllrersio^^^^^^ 

communication cost. To this end, the amount or aaia 10 d f in the form of select ion . (Jata. 

transmitted is reduced through conversion processes in the and °'^'P"^ '''' J^^^i^j^^^ the 

transmission side. In this case, care must be taken so as to F^'J-f^^-^^g™ 

avoid an excessive deterioration of the miage q^al' V- To h. 60 f-jJ^^^Jf^J P^^^i J ^^^^ 2-layer separator 73 sepa- 

end, asshown in HG. 2, the image data ■-.^«Pa« ° ^ TafesrcolorSS 

plural number of data, and each data .s appropn^^^^^^^ See oftaage data and the second piece of image data, 

processed, whereby a good compromise between the reduc- S'^^P^*^; ^.^^^rting portion 74 converts 

tion of data amount and the detenoration of the image ^^J^^A^f ^^^^^^ g^, pjj^f i„,g, data. The 

""Se Imrg^data that is read out of an original by the second image-structure inverting portion 75 converts the 

scalier Sh of the image communication apparatu.ses 51 image stnicmre of the second image data. 
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m select^ata compressing portion 76 compresses the ^^e i» ^^^^^^^ 

selection data. In this instance, the select^ata compressing f ^^^^.'^^^^^^^ °^ '^'^^ ^' 

portion 76 is binary data indicative of the first piece of image '''ii ^.^"^{."'i^.ge-structure convening portion 74 receives 
data or the second image data to which the image data is ^'"'^^ J j^t, from the 2-layer separator 73 
converted. Any of the data compression methods, e.g.. 5 ^^^^ ^^J^^^ ,^6 image structure of the image data. The first 
run-length, MH, MR, MMR, and arithmetic coding, may be ^ ^^^^ ^^^^^ ^^^^^ converted is input to the 
used for the select-data compressing portion 76. The hrst- ^j^i.^nage compressing portion 77 where it is compressed 
image compressing portion 77 compresses the first piece of . ^ j^juye data compressing method, e.g. , a JPEG method, 
image data. The second-image compressing portion 78 com- ^^^^ tesultam is stored into the transmission buffer 
presses the second image data. A data comfiression method 10 similarly, the second image data, which is output from 
suitable for the comp ression of co loiiT"'e''- e.g.- JPEG base. ^^^^ j-layer separator 73, is input to the second image- 
T W method. IS used tor both ibe dataxompressing portions . structure converting portion 75 where its image structure is 
■^Mger whBll tlm J I' UU tiim llhe melliucl i s used, the quan- converted. The second image data thus converted is input to 
4rttZltie table may be different for each data. the second-image compressingportioo^'^where^ 
Ji^etransmissL buffer 79 temporarily stores the com- is amOU£H£H5g^2»fcfa^^^ 
Dressed data output fromJheselect^taxomptessing portion .na Qi»rPri .ntoTEe transmission buttst-Za. , ^ ^ 
?6^dthe flrsr55d^econ^^ ^-Thrtmagr^irrm^^irpag^^ frem the 
Ind 78 At tS time taformation about ttie image structures scanner 61 is separated into three data; those separated data 
^Sh^corrs^^rd^^^^^^^^^^^ infon.ation.reld'ded in the -PPJO^^^^^^^^^^^ r=m£n 
form of a header to the compressed image data, so that the 20 tfJ^^.^°^'^'Xr Z controller 65 arranges the corn- 
data are arranged into an image data format as shown in J^^^JJ^^^t^^^^^^^^^^ 

its image structure conversion. ^'^Mtst formatting the image data, the controller 65 drives 

An operation of the image data separator 63 wU^ be J^ransS 66 which i^ turn starts thefransmis- 

When'another image communication apparatus receives the 

^^^^l^^^^^^^^^''^ cattn ploTcol! an^en 'receivL the image data. The 
^!?SS^S^^^ge=^'heatlributeofthe received image data is.input to the input Po^-j™ ^ °f 
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data into a first piece of image data, a second image data, and 
selection data to selectively designate one of the separated 
image data, accurately combines those separated data, and 
sends invention produces many advantages. The conversion 
process most suitable for each separated data is selected, so 5 
that the image quality is little deteriorated, and the amount 
of data is reduced. These facts allows a high speed data 
transmission, and save the memory capacity of the memory 
to store the image data, and enable the image data to be 
reproduced exactly and at high picture quality. Further, even jg 
if the input image data has any image structure, the image 
processing apparatus converts the image structure to that of 
the output device, and outputs the resultant to the output 
device. The output device reproduces the original image of 
high quality. 15 
What is claimed is: 

1. An image processing apparatus comprising: 

input means to which at least a first piece of image data 
compressed using a first compression type, a second 
piece of image data compressed using a second com- 20 
pression type, and selection data to selectively specify 
the first piece or the second piece of image data are 
input; 

image -structure converting means for converting the 
image structures of the first piece and the second piece 25 
of image data received from said input means to an 
image structure of an output device; and 

combining means for combining the first piece and the 
second piece of image data having the same image 
structure as of said output device on a basis of the 30 
selection data, wherein 

the image structure to be converted by said image- 
structure converting means is defined by a color space, 
and 

said combining means combines the first piece and the 
second piece of image data having the same color space 
as of said .output device on a basis of the selection data. 

2. The image processing apparatus of claim 1, wherein 
the image structure to be converted by said image- 

structure converting means is defined by the number of 
gradation levels, and 
said combining means combines the first piece and the 
second piece of image data having the same number of 
gradation levels as of said output device on a basis of 
the selection data. 

3. An image processing apparatus comprising: 

input means to which at least a first piece of image data 
compressed using a first compression type, a second 
piece of image data compressed using a second com- 
pression type having the same image structure as of the 
first piece of image data, and the selection data to 
selectively specify either of the first piece and the 
second piece of image data are input; 

combining and decompressing means for combining the 55 
first piece and the second piece of image data received 
from said input means on a basis of said selection data; 
and 

image -structure converting means for converting the 
image structure of the combined image data received 
from said combining means to the image structure of an 
output device, wherein 

the image structure to be converted by said image- 
structure converting means is defined by a color space, 
and 65 

said image-structure converting means converts a color 
space of the combined image data received from said 



913 Bl 

20 

combining means to another color space of said output 
device for outpulting said combined image data. 

4. The image processing apparatus of claim 3, wherein 
the image structure to be converted by said image - 

structure converting means is defined by the number of 
gradation levels, and 
said image-structure converting means converts the num- 
ber of gradation levels of the combined image data 
received from said combining means to the number of 
gradation levels of said output device for outputting 
said combined image data. 

5. An image processing apparatus comprising: 

input means to which at least a first piece of image data 
compressed using a first compression type, a second 
piece of image data compressed using a second com- 
pression type, and selection data to selectively specify 
either of the first piece and the second piece of image 
data are input; 

resolution recognizing means for recognizing the resolu- 
tions of the first piece and the second piece of image 
data and the selection data received from said input 
means; 

resolution converting means for converting the resolu- 
tions of the first piece and the second piece of image 
data, and the selection data received from said input 
means, which are received from said resolution recog- 
nizing means, to a resolution of an output device; and 

combining means for combining the first piece and the 
second piece of image data received from said resolu- 
tion converting means on a basis of the selection data. 

6. An image processing apparatus comprising: 

input means to which at least a first piece of image data 
compressed using a first compression type, a second 
piece of image data compressed using a second com- 
pression type, and selection data to selectively specify 
either of the first piece and the second piece of image 
data are input; 

resolution recognizing means for recognizing the resolu- 
tions of the first piece and the second piece of image 
data and the selection data received fr*om said input 
means; 

resolution converting means operating such that when 
after the resolutions of the first piece and the second 
piece of image data and the selection data received 
from said input means are recognized by said resolution 
recognizing means, said resolution converting means 
converts the resolution of the data, which is different 
from the resolution of an output device, to the resolu- 
tion of said output device; and 

combining means for combining the first piece and the 
second piece of image data received from said resolu- 
tion converting means on a basis of the selection data. 

7. An image processing apparatus comprising: 

input device to which at least a first piece of image data 
compressed using a first compression type, a second 
piece of image data compressed using a second com- 
pression type, and selection data to selectively specify 
the first piece or the second piece of image data are 
input; 

image-structure converting device for converting the 
image structures of the first piece and the second piece 
of image data received from said input device to an 
image stmcture of an output device; and 

combining device for combining the first piece and the 
second piece of image data having the same image 
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Structure as of said output device on a basis of the 
selection data, wherein 

the image structure to be converted by said image- 
structuring converting device is defined by a color 
space, and ^ 

said combining device combines the first piece and the 
second piece of image data having the same color space 
as of said output device on a basis of the selection data. 

8. The image processing apparatus of claim 7, wherein 
the image structure to be converted by said image - 

structuring converting device is defined by the number 
of gradation levels, and 
said combining device combines the first piece and the 
second piece of image data having the same number of 35 
gradation levels as of said output device on a basis of 
the selection data. 

9. An image processing apparatus comprising: 

input device to which at least a first piece of image data 
compressed using a first compression type, a second 20 
piece of image data compressed using a second com- 
pression type having the same image structure as of the 
first piece of image data, and the selection data to 
selectively specify either of the first piece and the 
second piece of image data are input; 25 

combining and decompressing device for combining the 
first piece and the second piece of image data received 
from said input device on a basis of said selection data; 
and 

image -structure converting device for converting the 
image structure of the combined image data received 
from said combining device to the image structure of an 
output device, wherein 

the image structure to be converted by said image- 
structuring converting device is defined by a color 
space, and 

said image-structuring converting device converts a color 
space of the combined image data received from said 
combining device to another color space of said output 40 
device for output ling said combined image data. 

10. The image processing apparatus of claim 9, wherein 

the image structure to be converted by said image- 
structuring converting device is defined by the number 
of gradation levels, and 45 

said image-structuring converting device converts the 
number of gradation levels of the combined image data 
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received from said combining device to the number of 
gradation levels of said output device for outputting 
said combined image data. 

11. An image processing apparatus comprising: 

input device to which at least a first piece of image data 
compressed using a first compression type, a second 
piece of image data compressed using a second com- 
pression type, and selection data to selectively specify 
either of the first piece and the second piece of image 
data are input; 

resolution recognizing device for recognizing the resolu- 
tions of the first piece and the second piece of image 
data and the selection data received from said input 
device; 

resolution converting device for converting the resolu- 
tions of the first piece and the second piece of image 
data, and the selection data received from said input 
device, which are received from said resolution recog- 
nizing device, to a resolution of an output device; and 

combining device for combining the first piece and the 
second piece of image data received from said resolu- 
tion converting device on a basis of the selection data. 

12. An image processing apparatus comprising: 

input device to which at least a first piece of image data 
compressed using a first compression type, a second 
piece of image data compressed using a second com- 
pression type, and selection data to selectively specify 
either of the first piece and the second piece of image 
data are input; 

resolution recognizing device for recognizing the resolu- 
tions of the first piece and the second piece of image 
data and the selection data received from said input 
device; 

resolution converting device operating such that when 
after the resolutions of the first piece and the second 
piece of image data and the selection data received 
from said input device are recognized by said resolu- 
tion recognizing device, said resolution converting 
device converts the resolution of the data, which is 
different from the resolution of an output device, to the 
resolution of said output device; and 

combining device for combining the first piece and the 
second piece of image data received from said resolu- 
tion converting device on a basis of the selection data. 

t * 9|c 4e * 
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